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Perspective 

Risk factors identified in previous education research include coming from a low-income family 
or single -parent household, having parents who did not complete high school, and having parents 
who speak a language other than English in the home (Croninger and Lee 2001; Pallas, Natriello, 
McDill 1989; Rathbun and West 2004; Zill and West 2001). Previous studies have found 
associations among these family background characteristics and poor educational outcomes, 
including low achievement scores, grade repetition, and dropping out of high school. Many 
children with one risk factor have other family risks present. For instance, children in single- 
parent households are likely to also live in poverty (Pallas, Natriello, and McDill 1989; Rathbun 
and West 2004). Given that family risks may occur alone or in combination, it is important to 
examine relationships between particular sets of risks and children’s early school achievement to 
explore whether children with certain types of risk factors begin school demonstrating fewer 
reading and mathematics skills than other kindergartners, and whether they fall further behind 
other children in reading and mathematics over the first four years of school. 

Previous research has found that the association between family risks and children’s reading and 
mathematics achievement is apparent in kindergarten and may not diminish in the early grades 
(Fryer and Levitt 2004; Lee and Burkam 2002; West, Denton, and Germino Hausken 2000; West, 
Denton, and Reaney 2001; Zill and West 2001). At school entry, children with one or more 
family risk factors, such as having a primary home language that is non-English or living in a 
single-parent household, have lower achievement scores in reading and mathematics when they 
start kindergarten than children with no factors. Furthermore, initial socioeconomic achievement 
gaps widen over the first few years of school (Downey, von Hippel, and Broh 2004; Rathbun and 
West 2004). As the number of family risk factors increase, children tend to gain less in reading 
and mathematics, after controlling for children’s sex, number of family risk factors, kindergarten 
program type (half or full day), and school type (public or private) (Rathbun and West 2004). 

Researchers have compared different analytic approaches to examine the relationship between 
family risk factors and children’s social and academic development (Ackerman et al. 1999; 
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Burchinal et al. 2000; Gutman, Sameroff, and Cole 2003; Sameroff et al. 1993). In one approach, 
sometimes called the additive factors or multiple predictor approach, individual risk factors are 
used as predictors of children’s development in a multivariate analysis to explore the unique 
effects of each risk factor. The benefits of this approach are that it retains the full predictive 
power of each risk in the original variable set and it allows for the evaluation of the relative 
importance of each risk factor. The drawback to this approach is the loss of statistical power to 
detect significant relationships, especially when sample sizes are small and the number of 
individual risk factors under consideration is large. An additional disadvantage of this approach is 
the potential for overlap or correlation among predictors, which can obscure meaningful 
relationships of individual risk factors with outcomes due to deflated parameter estimates. A 
second approach, sometimes called the composite or cumulative risk index approach, involves the 
creation of a single, multiple risk index based on a series of dichotomous risk ratings, which is 
then used as a predictor of children’s social or academic development. The benefits of this 
approach are that it enables researchers to simultaneously consider multiple risks with a single 
predictor. This feature is especially attractive when analyzing data sets with relatively small 
samples. The drawback to this approach is that it does not allow for identification of specific 
relations between risk factors, alone or in combination, and child outcomes. 

Many of the studies that compare approaches to examining the relationship between risk factors 
and child outcomes have been based on relatively small sample sizes and have included large 
numbers of contextual risk factors as predictor variables. Furthermore, in many instances the 
samples were not representative of the U.S. population of children; rather, they tended to focus on 
minority children or those who had certain risk factors present (e.g., large proportion of families 
in poverty, overrepresentation of parental psychopathology). With such samples, researchers 
noted that the composite or cumulative risk index approach tended to provide the greater 
statistical power for examining the relationships between risk factors and child outcomes than the 
multiple predictor approach (Burchinal et al. 2000; Gutman, Sameroff, and Cole 2003). Flowever, 
exploring the unique effects of risk factors allows for the isolation of qualitatively distinct sources 
of contextual risk (Ackerman et al. 1999). 

Using data from the Early Childhood Longitudinal Study, Kindergarten Class of 1998-99 (ECLS- 
K), this paper extends the findings from prior research. First, it explores whether kindergartners’ 
reading and mathematics gains over the first 4 years of school are more strongly associated with 
particular risk factors alone or in combination, as opposed to the cumulative number of family 
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risk factors a child experiences. Second, the analysis makes use of the reading and mathematics 
data collected at 4 time points (i.e., fall kindergarten, spring kindergarten, spring first grade, and 
spring third grade) to describe achievement growth over time, rather than using scores from two 
time points (fall kindergarten and spring third grade) as a measure of academic gain. 

Data Source 

The ECLS-K, sponsored by the National Center for Education Statistics (NCES), within the U.S. 
Department of Education’s Institute of Education Sciences, has followed a nationally 
representative sample of kindergartners from the fall of 1998 through the spring of 2004, when 
most of the children were enrolled in fifth grade. 1 The study collects information directly from 
the children and their families, teachers, and schools. The full ECLS-K base-year sample is 
composed of 22,782 children who attended 1,277 schools with kindergarten programs during the 
1998-99 school year. 

The findings in this paper are based on the 10,345 children in the ECLS-K sample who entered 
kindergarten for the first time in 1998, were administered the English version of the ECLS-K 
cognitive assessments in fall 1998, spring 1999, spring 2000, and spring 2002, and have complete 
data on their sex, race/ethnicity, and each of the four family risk factors included in the paper. 2 
Prior to administering the assessments in kindergarten and first grade, children’s English 
proficiency was evaluated. Children whose home language was other than English (as determined 
by school records) were administered the Oral Language Development Scale (OLDS). Those 
children who reached the specified criterion on the OLDS were then assessed with the English 
version of the ECLS-K assessments. 3 Approximately 68 percent of Hispanic children and 78 
percent of Asian/Pacific Islander children were assessed in English in the fall and spring of 
kindergarten and in the spring of first grade (Denton and West 2002). In the third-grade year, the 



'The ECLS-K website ( http://nces.ed.gov/ecls/ ) provides information on the study and details on how to order 
publications and data files. 

Estimates in this report are weighted by the ECLS-K longitudinal full-sample child weight, C1_5FC0. 

3 If children did not pass the OLDS in a given round, they were retested again in later rounds of kindergarten and first 
grade with the OLDS until their English proficiency permitted them to take the ECLS-K assessments. 
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OLDS was not administered and all children were assessed in English. Since children who did not 
pass the OLDS in fall of kindergarten do not have reading and mathematics scores for all rounds, 
they were excluded from the analyses in this report. 4 

The weighted school response rate for the kindergarten year - was 74 percent. The child and parent 
completion rates in the kindergarten year - were 92 percent and 89 percent, respectively. In the 
spring of 2002, 80 percent of the children and 77 percent of the parents who were eligible for the 
third-grade data collection participated in the study (Rathbun and West 2004). 

Comparisons in the text arc tested for statistical significance to ensure that the differences arc 
larger than might be expected due to sampling variation. All differences described are significant 
at the .05 alpha level. Due to the large sample size, many differences (no matter how 
substantively minor) are statistically significant. Effect sizes are also included in the paper to 
provide a measure of the magnitude of differences between estimates. Cohen’s (1988) convention 
for interpreting effect sizes considers effect sizes of .20 as small, .50 as medium, and .80 as large. 

Measures 

Information in this paper was collected through parent interviews conducted in the kindergarten 
year - and repeated, one-on-one child assessments in the fall and spring of kindergarten, spring of 
first grade, and spring of third grade. Below is a brief description of the key measures and 
characteristics used from these information sources. The variables created for the analyses come 
from the ECLS-K Longitudinal Kindergarten-Third Grade public-use data file (NCES 2004- 
089). Variable names from the ECLS-K database arc included in the descriptions using the 
kindergarten names and are indicated in all capital letters. 



“initially the analyses included the sample of students who were not able to be assessed in English in the early rounds 
of the study due to limited English proficiency since many of these children had valid assessment scores in later rounds. 
However, because the missing assessment data for these children were not randomly distributed, the level- 1 data 
violated assumptions of HLM and led to incorrect level-2 coefficients of children’s achievement. In an earlier report 
(Denton and West 2002), analyses were conducted to explore how including children who initially could not take the 
battery in English but were tested by spring of first grade would impact achievement estimates. Significant reading t- 
score differences overall and by specific racial/ethnic group were not detected between the sample assessed in English 
at all time points and the total sample, including those who were able to be tested with the English assessment at a later 
time. In third grade, the reading t-scores for children whose home language was non-English did not differ based on 
whether they had sufficient English skills to take the ECLS-K battery at kindergarten entry or at later rounds (t-scores 
of 49.2 and 48.2, respectively, t-test value = 0.465). 



5 




Presence of family risk factors in the kindergarten year (4 variables). This paper uses four family 
characteristics identified in previous research as potential risk factors for children’s school 
achievement. Risk factors used in the analyses come from parent reports in the kindergarten year. 
The four risk factors examined included: 

1) Living in a single-parent household (i.e., mother-only or father-only household) (P2HFAMIL, 
collapsed) 

2) Living below the federal poverty threshold (WKPOV_R) 5 

3) Having a primary home language that is not English (WKLANGST) 

4) Having a mother who did not complete high school (i.e., did not receive a high school diploma 
or GED) (WKMOMED, collapsed). 

Children’s cognitive knowledge and skills. The ECLS-K reading and mathematics assessments 
measure children’s status in each subject in kindergarten, first, and third grade and provide a 
means of measuring academic growth since kindergarten entry. The reading assessment includes 
children’s basic literacy skills, vocabulary, and comprehension items. The mathematics 
assessment measured children’s conceptual understanding of numbers, shapes, patterns, 
mathematical operations, and processes for problemsolving (for more details on the psychometric 
properties of the ECLS-K assessments, please see Pollack et al. forthcoming; Rock and Pollack 
2002). The analyses in this paper use the overall achievement score for each subject area, which 
is an Item Response Theory (IRT) scale score. Assessment data from the fall and spring of 
kindergarten (fall 1998 and spring 1999), the spring of first grade (spring 2000), and the spring of 
third grade (spring 2002) are analyzed. 6 (Reading variables: C1R2RSCL, C2R2RSCL, 
C4R2RSCL, C5R2RSCL; Mathematics variables: C1R2MSCL, C2R2MSCL, C4R2MSCL, 
C5R2MSCL). 

Elapsed time between assessments. The date of assessment was recorded at each data collection 
period (e.g., in the kindergarten year, C1ASMTMM (month), C1ASMTDD (day), 
ClASMTYY(year)). The elapsed time, in months, was calculated between the initial assessment 
(in fall kindergarten) and each later assessment (i.e., spring kindergarten, spring first grade, spring 

5 The federal poverty level status composite variable is derived from household income and the total number of 
household members. Federal poverty thresholds are used to define households below the poverty level. For instance, in 
1998 if a household contained 4 members, and the household income was lower than $16,655, then the household was 
considered to be in poverty. 

This paper refers to data collected in the spring of 2002 as third-grade data and the sampled children as third-graders, 
although not all children in the sample used for this paper were enrolled in third grade. In the spring of 2002, about 89 
percent of the sample children were in third grade. 10 percent were in second grade, and about 1 percent were enrolled 
in other grades (e.g., first or fourth grade). 
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third grade). The elapsed time variable is used in the analyses to describe the amount of reading 
and mathematics gains children demonstrated each month since the fall kindergarten assessment. 

Control variables. Children’s sex and race/ethnicity are included as control variables in the 
analyses given that previous research has found relationships between these characteristics and 
children’s achievement in reading and mathematics (Downey, von Hippel, and Broh 2004; 
Rathbun and West 2004; West, Denton, and Germino Hausken 2000; Zill and West 2001). 
Furthermore, although race/ethnicity is related to the number of family risk factors a child may 
experience (Zill and West 2001), each of the two characteristics is also independently related to 
children’s achievement gains over the first 4 years of school (Rathbun and West 2004). 

• Child’s sex: Male or female (GENDER). 

• Child’s race/ethnicity: White, non-Hispanic; Black, non-Hispanic; Flispanic, Asian/Pacific 
Islander; and Other, non-Flispanic (which includes American Indians, Alaska Natives, and 
non-Flispanic multiracial children). (RACE, collapsed). 

Findings 

Zill and West (2001) found that 46 percent of all first-time kindergartners had at least one risk 
factor present. Twenty-three percent came from single-parent households, 14 percent of 
children’s mothers had not completed high school, 18 percent of children’s families were on 
welfare or received food stamps, and 9 percent of children lived in a household where English 
was not the primary language. Of those first-time kindergartners who were administered the 
ECLS-K assessments beginning in the fall of kindergarten (i.e., the sample used for this paper), 
39 percent had at least one family risk factor in their first year of school. Twenty-five percent 
came from single -parent households, 11 percent of children’s mothers had not completed high 
school, 1 8 percent lived below the federal poverty threshold, and 5 percent of children lived in a 
household where English was not the primary language. Twenty-three percent of kindergartners 
had exactly one of the four risk factors, 12 percent had two risk factors, 4 percent had three risk 
factors, and less than 1 percent had all four risk factors in kindergarten. The percentages of 
children with different numbers and types of risk factors in this paper are in some cases lower 
than the percents reported by Zill and West (2001) because the analytic sample for their report did 
not exclude kindergartners who were unable to take the assessments due to limited English 
proficiency. For example, the percent of children from homes with non-English primary language 
who also lived in poverty was larger for the population of first-time kindergartners than it was for 
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the sample of children who were fluent enough in English to take the assessments when they 
began kindergarten (44 percent vs. 31 percent, respectively) (data not in table). 7 

Certain patterns of family risks were more prevalent than others (table 2). For instance, while 24 
percent of kindergartners living in poverty had no other risk factors, 60 percent of poor 
kindergartners also lived in a single -parent household. Also, children whose primary home 
language was not English were more likely than those whose mothers did not complete high 
school to have only one risk factor (45 percent vs. 32 percent, respectively). Thus, it is important 
to look specifically at the associations of particular' combinations of risk factors that children 
experience with their achievement growth to explore whether certain types of risk factors are 
more strongly associated than others with children’s initial achievement and their growth in 
reading and mathematics in the first four years of school. 

HLM Analyses 

Two-level hierarchical linear modeling (HLM) was used to describe the achievement growth of 
children with different types and numbers of family risk factors. Analyses were conducted 
separately for reading and mathematics. At level 1, children’s individual growth trajectories were 
modeled based on their assessment scores from multiple occasions (fall K, spring K, spring 1 st 
and spring 3 rd ). Thus, the level 1 model is: 

Yy = 7t 0 i + 7r u a ti + e ti 

Where Y ,, is the child’s subject-area score at a given time point, a ti is the elapsed time (i.e., 
number of months) since the initial (fall K) assessment, Tto; is the child’s initial (fall K) 
achievement score (i.e., at 0 months), and Tin is the growth rate over the first 4 years of school, 
which represents the child’s expected change in achievement each month. This model assumes 
that errors (e,j) are independent and normally distributed, with a common variance (Bryk and 
Raudenbush 1992). 



7 

Standard error for full sample estimate = 1.9; standard error for analysis sample = 



2.3. 
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The level 2 model incorporated child-level characteristics (i.e., child’s sex, race/ethnicity, and the 
4 family risk factors). 8 These variables arc included as predictors in the second-level equations 
of both the intercept and growth-rate parameters. The level 2 models arc: 

Jio, = poo + poi(MALE) + p 02 (BLACK) + p 03 (HISPANIC) + p 04 (ASIAN/PI) + p 05 (OTHER) + 
p 06 (FIRST RISK) + p 07 (SECOND RISK) + ... + p 0j (LAST RISK) + r 0i 

Tin = p 10 + pn(MALE) + p 12 (BLACK) + p 13 (HISPANIC) + p 14 (ASIAN/PI) + p I 5 (OTHER) + 
Pi 6 (FIRST RISK) + p 17 (SECOND RISK) + ... + Pij(LAST RISK) + r u 

The estimates of the p 0 j and pij coefficients describe the amount of initial differences (i.e., in fall 
kindergarten) and differences in growth over time, respectively, that can be associated with each 
of the child-level predictors. 

A series of HLM analyses were conducted to compare findings for the relationship between 
children’s achievement and 1) a cumulative risk factor index; 2) the four individual risk factor 
variables; and 3) unique combinations of the four risk factors, as represented by a series of 
dummy-coded variables. 9 The first analysis included a single level-2 risk predictor (i.e., 
cumulative number of risk factors for a child) and the second analysis included four level-2 risk 
predictors (i.e., dummy codes for whether the child lived below the poverty threshold, lived in a 
single-parent household, had a mother who did not complete high school, and had a primary 
home language that was not English). For the third analysis, 1 1 dummy-coded combinations of 
risk factors were created: 

Children with only 1 risk factor: 

1. Living below the poverty threshold 

2. Living in a single -parent household 

3. Having a mother who did not complete high school 

4. Having a primary home language that is not English 



8 For the purposes of the current presentation, we did not include school as a third level in the HLM models because of 
complexities introduced by student mobility over the 4 years of the data collection. 

9 Using a complete set of dummy-coded variables in the HLM analyses yields the same results as a model that includes 
all main effects and 2- and 3-way interactions between the 4 risk factor variables. The advantage of using the dummy- 
coded combinations is that the coefficients and standard error terms for each unique combination of risk factors is 
already calculated in the analysis output, allowing for easier interpretation and comparison for children with different 
combinations of risk factors. 
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Children with two risk factors: 



5. Living below the poverty threshold and in a single -parent household 

6. Living below the poverty threshold and having a mother who did not complete high school 

7. Living below the poverty threshold and having a primary home language that is not English 

8. Living in a single -parent household and having a mother who did not complete high school 

9. Living in a single -parent household and having a primary home language that is not English 

10. Having a mother who did not complete high school and having a primary home language that 
is not English 

Children with three or four risk factors: 

1 1 . Three or four of the four risk factors present 

Although children with three or four risk factors could also be separated into unique combinations 
of multiple risk factors (e.g., living below the poverty threshold, living in a single -parent 
household, and having a mother who did not complete high school; having all four risk factors 
present), most of the combinations yielded small sample sizes, as noted in table 1. Since the small 
sample size precluded reporting estimates for some of these multiple risk categories, children 
with three or four risk factors were grouped together into a single dummy-coded variable of three 
or four risk factors. 

The risk factor variables for each of the three analyses were entered as level-2 predictors of 
children’s initial (fall kindergarten) achievement and as predictors of children’s achievement 
growth from fall kindergarten to spring of third grade. In addition, children’s sex and 
race/ethnicity were included as control variables. 

The regression coefficients reported in the text and tables of this paper are unstandardized 
coefficients, representing the change in mean score points for a child with a given risk factor. For 
example, if the reported regression coefficient for being in poverty was -1.2, this would indicated 
that a child living below the poverty threshold would score, on average, 1.2 points lower than a 
child living at or above the poverty threshold. The coefficients for each of the predictor variables 
were checked for significance, indicating that a child with a particular risk or combination of risk 
factors had different achievement status or growth than a child with no risk factors. Post-hoc Most 
comparisons with Bonferroni adjustment 10 were also conducted in the third set of analyses to 
compare the coefficients for children with various combinations of risk factors to determine 



l0 The Bonferroni adjusted critical t-value for the second set of analyses is set at 2.87 for 12 comparisons and is set for 
the third analysis at 3.50 for 110 comparisons (2-tailed tests). 
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